Information theoretic novelty detection

Information theoretic novelty detection

We present a novel approach to online change detection problems when the training sample size is small. The proposed approach is based on estimating the expected information content of a new data point and allows an accurate control of the false positive rate even for small data sets. In the case of the Gaussian distribution, our approach is analytically tractable and closely related to classic...

Sentence Level Information Patterns for Novelty Detection

SENTENCE LEVEL INFORMATION PATTERNS FOR NOVELTY DETECTION JULY 2006 XIAOYAN LI, B.E. TSINGHUA UNIVERSITY M.E., TSINGHUA UNIVERSITY Ph.D. UNIVERSITY OF MASSACHUSETTS AT AMHERST Directed by: Professor W. Bruce Croft The detection of new information in a document stream is an important component of many potential applications. In this thesis, a new novelty detection approach based on the identific...

Information-Theoretic Measures for Anomaly Detection

Anomaly detection is an essential component of the protection mechanisms against novel attacks. In this paper, we propose to use several information-theoretic measures, namely, entropy, conditional entropy, relative conditional entropy, information gain, and information cost for anomaly detection. These measures can be used to describe the characteristics of an audit data set, suggest the appro...

Detection of signals by information theoretic criteria

An information theoretic foundation of synchronized detection

The constrained capacity of a coherent coded modulation (CM) digital communication system with data-aided channel estimation and a discrete, equiprobable symbol alphabet is derived under the assumption that the system operates on a flat fading channel and uses an interleaver to combat the bursty nature of the channel. It is shown that linear minimum mean square error channel estimation directly...